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Abstract 

Several stochastic models called thermal ratchet models have been 
recently proposed to analyze the motor proteins such as myosin and 
kinesin,etc. We propose a method to study the energetics of those 
models, and show how the rate of energy consumption and the energy 
dissipation are evaluated. As a demonstration we consider "Feynman's 
ratchet" , a typical fluctuating heat engine. 

The motor proteins, such as myosin or kinesin, act as the energy trans- 
ducer in our lives, i.e., they produce mechanical work as they consume chem- 
ical energy. Motivated by such systems various phenomenological models 
have recently been proposed. fl], j|, [| f|, |5[] These models, which are called 
thermal ratchet models, share the common feature that the net work is ob- 
tained by rectifying the random thermal fluctuation of the system and that 
the energy of chemical reaction is implicitly supposed to be consumed for 
operating the rectifier, but not for driving the system directly. 
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By now there are no systematic study of the energetics of those models. 
In most of the literatures the model stochastic equation (see eq. (|l|) below) or 
the equivalent Fokker-Planck equation || have been solved, and the average 
power output has been calculated, while no assessment has been done to the 
total consumption of the energy and/or the energy wasted into heat bath. To 
the author's knowledge the only literatures on thermal ratchet model which 
refers the energetics are the following: Feynman |7j invented what is called 
Feynman's ratchet today and and analyzed in his textbook the energetics 
in a qualitative argument. Magnasco || considered so-called Szilard's heat 
engine and claimed an expression of the net power consumed by the machine 
in steady state (see eq.(^) below). Also there is a proposal of the formula of 
the total energy consumption || (with no derivation) which is variant from 
our result. 

It is of much interest to study the energetics of biological systems since, in 
actuality, some of the motor proteins is reported to have very high efficiency 
of energy conversion. || Form theoretical point of view, the formalization of 
energetics is motivated in relation to the question: "what should the compre- 
hensive phenomenological model of motor protein be?" If a model of motor 
protein incorporates explicitly the chemical reaction processes, that is, bind- 
ing of adenosine triphosphate (ATP), hydrolysis of the ATP and releasing 
of the hydrolysis products, then the energetics such as the efficiency of en- 
ergy conversion should be tested within the model, and the framework given 
below will play a decisive role for such analysis. The existing models of ther- 
mal ratchets, however, do not yet fully incorporate the reaction dynamics, 
but merely assume that the reaction dynamics is somehow correlated to the 
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dynamics of the model. The analysis of the energetics of such model and its 
comparison with real experimental results should, therefore, serve to judge 
how substantial part of the energetics is grasped within the model. 

In regard to the present status mentioned above, we would like to present 
an approach to the energetics of stochastic models of thermal ratchet or, more 
specifically, to show how one can define the rate of total energy consumption 
or the rate of energy dissipation into heat. The main purpose of this Letter is 
to describe a basic framework and we will not exhaust the application to all 
the existing models. After establishing the framework the latter task can be 
done in principle with the knowledge of the pertinent probability distribution 
functions which are already given in the literatures. Below we firstly describe 
the general idea, and then we specify it for three typical categories of the 
existing models. After that we take up a version of so-called Feynman's 
ratchet model, as a demonstration, and show several concrete results of 
energetics. 

General argument: In the thermal ratchet models, the whole system con- 
sists of the following four parts: 

(i) the energy transducer, whose state variable is denoted by x, which may 
be generalized to be more than one degree of freedom, 

(ii) the external system, whose state variable is denoted by y, 

(iii) the heat bath, and 

(iv) the load L to which the transducer does work. 

The interaction of the transducer with the external system and the one 
with the load are assumed to be potential-like with the potential U(x, y) = 
Uo(x,y) + Lx, where Uq is a periodic function of x with a period £, i.e., 
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Uo(x+£, y) = Uq(x, y). The interaction with the heat bath is treated stochas- 
tically so that the heat bath exerts an instantaneous force —^dxjdt + £(£), 
where 7 is the friction constant and is, as usual, the white Gaussian 
process characterized by the ensemble averages, (£(£)) = and (£(£)£(£')) = 
(2^/0)8{t — if) with (3 = (k^T) -1 being the inverse of the temperature of 
the bath times Boltzmann constant. The external system is assumed to be 
statistically independent of £(t). 

The dynamics of the system is described by the following Langevin equa- 
tion; 

dU(x, y) \ dx . 

' + -1— + C(t) =0, x{t i )=x i . (1) 



dx 

The property of the external system is not specified at this point except that 
the variation of y leads to a bounded variation for U, that is, whether y(t) 
itself varies in a bounded region |2], ||, [7], |l(| or [/ is assumed to be periodic 



with respect to y JT1 



We introduce the three quantities concerning the energetics of the system: 

(a) the work W done by the transducer to the load during the period, say, 
ti < t < ti, which is formally given as 

W = U(x{t f ),y(t f )) - Uixit&yiU)), (2) 

(b) the dissipation of energy D to the heat bath, and (c) the total consump- 
tion of energy R coming from the external system in the meantime. The 
low of energy conservation requires the relation W + D — R. As noted 
before, there are many calculation of the first quantity in the form of av- 
erage power, (dW/dt) = L(dx/dt), where (dx/dt) can be directly obtained 
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from the simulation of the Langevin equation (fl]) or by solving the equiva- 
lent Fokker-Planck equation and integrating the probability current over a 
section perpendicular to the 

Our reasoning for obtaining the remaining two quantities is based on 
the following observation: The equation ([!]) embodies the balance of forces 
acting on the transducer and, therefore, the transducer exerts the reaction 
force — [— 'jdx/dt + £(£)] to the heat bath. Then, the dissipation, which is 
the work done by the transducer onto the heat bath, is given as the following 
Stieltjes integral 

rt=t f 

dt 

dU((x(t),y(t)Y 



D 



t=u 



-7— + 



t=tt 



t=u 



dx 



dx(t) 
dx(t). 



(3) 



To move on to the second line on the right hand side we have used ([]]). We 
should note here that the probability theory tells that the above integrals 
should be interpreted as the stochastic one in the Storatonovich sense, and 
that we can perform the usual integration rules such as integration by parts 
or the change of integration variable. By the conservation law W + D = R 
the total consumption of the energy becomes 



R 



t=u 



du( x (t)Mt))- aU{x f- v{t)) dx(t) 



(4) 



Below we apply the above formula of R to the three categories of models 
with different assumptions on the variable y(t), and show how this formula 
can be transformed into a physically appealing expression. 

Category 1: y(t) is a given periodic function, y(t + T) = y(t). || |J In 
this case we may write U(x,y(t)) as U(x,t) and using the identity dU = 



(dU/dx)dx+ {dU/dt)dt, (|) becomes, 
D _ rtt dU(x(t),t) 




dt, (Category 1). 



(5) 



This expression tells that the input of energy from the external system is 
done by lifting the potential U while the state of the transducer, x, is vir- 
tually fixed. Suppose that the probability distribution function P(x, t) is 
available as the solution of the Fokker-Planck equation which corresponds 
to (D, dP/dt = -dJ/dx, where J = -7- 1 (p- 1 dP/dx+ PdU/dx) is the 
probability current, and the initial condition P(x, 0) = 5(x — Xi) is satisfied. 
The average (R) is then given as 



where Q is the domain of the variable x. Although we treat x as a single 
degree of freedom for the simplicity of explanation, the generalization to 
more than two degrees of freedom |l2j is straightforward. We can show after 
integration by parts that (||) is equivalent to the following expression for (D), 



probability distribution, for a time independent potential. 

Category2: y(t) obeys discrete Markov process. |2|, |J ||, [12| The value of 
x(t) is assumed to be continuous upon the jump of y(t) from one discrete 
value to the other. Let us denote by {t,} the times at which such jumps 
occur upon a particular realization of y(t). Then R in @ becomes 







Magnasco || has discussed a similar expression in the case of steady state 
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(Category 2), 



(8) 
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where the sum is taken for all the jumps occurred during ti and tf. This result 
shows that, as in (|5|), the external system puts energy into the transducer by 
lifting the potential with x taking its instantaneous value. 

In order to calculate the average (R), we introduce the transition proba- 
bility of y: If we distinguish by {a} the possible discrete values of y, the prob- 
ability distribution function, of x and y, P a (x,t), obeys the Fokker-Planck 
equation like the following form, ||, ||, [L3| 

dP a d.J a 



dt dx 



+ £p ff ,wg CT -E p -w-'> ( 9 ) 



where J a = — 7 _1 ([3~ 1 dP (T /dx+ P a dU a / dx) and U a (x) denote, respectively, 
the probability current in the domain of x-variable, Q, and the potential with 
y taking its cr-th value, and W aa > is the transition rate of y from cr-th to cr'-th 
value. iyV aa i can be a function of x and t.) Using W aa i and the probability 
P a (x,t) the average consumption (R) is given as, 

(R) = ^ f h dtjdxY, E( p -^-' - PcW^) x 
2 Ja Jn ^ 

x[U a/ -U a ], (10) 

where the argument x has been suppressed. From this expression it is clear 
that the net consumption of the energy comes out from the lifting of potential 
due to the breaking of the detailed balance with respect to y-values. 

Category 3: y{t) is a stochastic process influenced by the second heat 
bath. 0j y(t) is assumed to obey the following Langevin equation, 



dU(x,y) 
dy 



0, y(ti)=y, (11) 
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where the second heat bath is characterized by 7 and (3(^ (3) through the 
conditions, (£(£)) = and (£(£)£(£')) = ffil ~ The above equation 
tells the balance of forces on the degree of freedom, y, just as (|l|) does on 
x. By the same reasoning as we derived eq. (Q), the consumption of energy 
from the second heat bath, R, is given as 



R 



t=t f 
t=u 



= -D 



dU(x(t),y(t)Y 
dy 

(Category 3) 



dy(t), 



(12) 



Using the identity dU = (dU/dx)dx+ {dU jdy)dy we can verify that D + D + 
W = holds. 

In the present case the above stochastic integral R should be evaluated 
directly, not via the form like (|5|) above. The evaluation of (R) (= —(D) 
or (D)), therefore, requires some care about the Storatonovich calculus. |§ 
Noting that the probability distribution of dx(t) and dy(t) obeys the Fokker- 
Planck equation with the initial condition specified at the time t, and that 
dU/dx or dU /dy should be evaluated at the midpoint, t + dt/2, as a rule of 
Storatonovich calculus, we arrive at the expressions; 

dU(x,y)~ 



(D) 



(D) 



dt dx dy 
u Jn Jq 

dt I dx f dy 

u Jn Jh 



dx 

dU{x,y) 
dy 



J. 



J. 



(13) 



(14) 



where f2 is the range of the variable, y, and J = — 7 _1 (/3~ 1 dP/dy+ PdU/dy) 
is the probability current of y. In the absence of the load, L = 0, the 
transducer described by (jH) and ( pTTj) acts as a passive heat conductor. Es- 
pecially, for harmonic coupling U(x,y) = (k/2)(x — y) 2 with k > 0, we 



can directly calculate the energy conduction rate; — {dD/dt) = (dD/dt) = 
fc0-i-/3-i)/( 7 + ^). 

Two remarks: Firstly the derivation of the expressions (|7|), (|H|) and (|14]) 
from the stochastic integrals (0) or (^) can be done more shortly but symbol- 
ically by regarding v = — 7 _1 (j3~ 1 d/dx+ dU/dx) or v = — 7 _1 (/3~ 1 d/dy+ 
dU I dy) as the velocity operators along x and y directions, respectively, and 
rewriting, for example, $1=1/ ([— dU/dx\dx{t)) as ft/ dt ([—dU/dx]v), etc. 

Secondly in the above description the probabilities and the currents have 
been assumed to be the solutions of the initial value problem with a definite 
initial value of x (and of y) at the initial time t = ti. We can show, however, 
that in the long-time limit the integrals in @, (0), fllPf ), (|i~3|) and (fill) may 



be alternatively evaluated by using the solutions of Fokker-Planck equation 
which are periodic along x-direction with the period I (and, for Category 
1, along t— direction with the period T) under the normalization condition 
imposed within the spatial period. If we use such solutions, the integral J n dx 
in the equations mentioned above should be replaced by that over the period 
£, say, Jq dx. 

Example: Feynman's ratchet. Feynman invented a thoughtful heat en- 
gine consisting of a ratchet wheel joined tightly to a rotatable vane immersed 
in a first heat bath, and a pawl that is loosely attached by an elastic spring 
to the ratchet's tooth and is immersed in a second heat bath. The profile of 
the tooth of the ratchet is asymmetric and the temperatures of the two heat 
baths are made different. It has been shown 0] that in this non-equilibrium 
system the ratchet wheel can generate a torque even under a load. Depend- 
ing on the temperatures of the heat baths, one of the baths acts as a source 
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of energy, while the other bath acts as a breaking media, or a cooling media, 
which absorbs the kinetic energy of the part immersed therein. If the effect 
of inertia is neglected, his model is a typical example of the transducer of 
the Category 3 described above. Since Feynman has left only qualitative dis- 
cussion on his model, the concrete description given below would be of some 
interest to demonstrate the feasibility of our framework. 

The valuable x in our notation corresponds to the angle of rotation of a 
ratchet wheel and y represents the displacement of the pawl. The potential 
U (x, y) can be given in the following form, 



where <f>(x) is the periodic function with a period t that represents the asym- 
metric saw-tooth profile of the ratchet and TJ\[z) stands for the short-range 
repulsion between the pawl and the ratchet. In the original model it is hard- 
core like; U\{z) = oo for z < and = for z > 0. The second term U2(y) 
is the potential devised so that the pawl is elastically pressed down onto the 
ratchet tooth. We show in Fig. [j] the contour plot of the potential energy 
U(x, y) as well as the profile of 4>(x), which we used in our calculation. The 
values of the other parameters are also given in the figure caption. 

As noted in the above remarks, in order to evaluate (D) or (D) we 
need only the stationary and periodic solution of the Fokker-Planck equa- 
tion dP/dt = —dJ/dx — dJ/dy, normalized within the range, < x < I. 
Using such solution, (dD/dt) is given as 



U(x, y) = Ui{y- <f>(x)) + U 2 (y) + Lx, 



(15) 




(16) 
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and (dD/dt) is obtained similarly. The average velocity (dx/dt) can be cal- 
culated as £ J^dyJ. The stationarity condition dJ/dx + dJ/dy = assures 
that the last integral is independent of the variable x. 

The result of our numerical calculation is given in Fig. 0. In the top 
figure we show the mean velocity (%) and the mean energy consumption 
rate for four values of the load. The efficiency t] can be calculated from 
these data as r\ = £(:ff}/(4f) and is shown in the bottom figure of Fig. £| 
Since both (||) and (^j?) depend almost linearly on the load, we can safely 
extrapolate to find that the velocity and the efficiency vanishes when the 
load is about 0.0057. In the steady states J and J generally compose a 
finite circulation dJ/dy — dJ/dx and, as Magnasco has pointed out, |§] these 
states are qualitatively different from equilibrium states even if vanishes; 
the coupling between x and y allows the transfer of energy even without 
doing work. The efficiency of the model turned out to be very small. It is 
because we have chosen a rather moderate potential variation (the difference 
of f3U(x, y) between the minima and the saddle points is about one) in order 
to assure the numerical accuracy. The feasibility of our formalism, however, 
should be understood by the present example. 

In this Letter we have developed the framework to analyze the energetics 
of thermal ratchets that work as energy transducers while keeping contact 
with heat bath(s). We have developed here the point of view that Langevin 
equations imply the balance of forces and that the energetics of the system 
can be analyzed based on this balance relation with the aid of a standard 
probability theory. We have not exhausted the possible application of our 
scheme; for example, the external system may be a chaotic dynamical sys- 
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tern. [[TJj] It is a future task to construct the comprehensive phenomenological 
model of motor proteins in which we should specify a biochemically correct 
expression of the external system. 
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Figure 1: In the top figure the contour plot 
of the potential U(x, y) is shown. The pa- 
rameters we have chosen for ( |T5| ) in the text 
are such that U\(z) = e~ z and U 2 (y) = \y 1 
and the profile of (f)(x) is given in the bot- 
tom figure. The brighter region indicates 
the higher potential, and the spacing be- 
tween the contours corresponds to the height 
of 0.5. We have descretized the region of 
< x < i = 1 and -0.25 < y < 1.65 
into 50 x 35 points and imposed the periodic 
boundary condition at x = and x — i. As 
for the boundaries y = —0.25 and y = 1.65 
we required J to vanish so that the proba- 
bility is conserved within the regionl4f cal- 
culation. The inverse temperatures and the 
friction constants are chosen to be (3 = 2, 
(3 = 4, 7 = 1 and 7 = 1. 
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